REMARKS 

THE CLAIMS fjfk^ 

R EJECTION UN nFR as U.S.C 103 

A. Claims 1.3.*, «, «- **■ M- *«■ 42. 4S. and 46 



Claims 1 , 3, 5, 6, 13, 16, 39, 40, 42, 45, and 46 were rejected under 35 U.S.C. 
103(a) as being unpatentable over Jain etal., U.S. Pat. No. 5,911,139 (hereinafter 
'Jain"), in view of Polnerow et a!.. U.S. Pat. No. 5,813,006 (hereinafter "Polnerow"). 

Applicant respectfully traverses this rejection and submits that the claims on file 
are not obvious in view of Jain in light of Polnerow, and are patentable thereover. In 
support of this position, Applicant submits the following arguments: 

B. Legal Standards for O bviousness 

The following are court opinions set the general standards in support of 
Applicant's position of non-obviousness, with emphasis added for clarity purpose: 

. " Obviousness ^nnot be established by combining the teachings of the prior art 

to produce the claimed invention, absent some teaching or »"gfl*» ti y 

supporting the combination." In re Fine, 837 F.2dat 1075 5 USWft lSM 
(citing ACS Hosp. Sys. v. Montefiore Hosp., 732 F.2d 1572 1577 221U$PQ 
929 933 (Fed. Cir. 1984)). What a referen ce teaches and whether it teaches 
toward nr' awav from th* Calmed invention are questions of feci L See Raytheon 
Co. v. Roper Com-. 724 F.2d 951, 960-61, 220 

1983), cert, denied. 469 U.S. 835. 83 L Ed. 2d 69, 105 S. Ct. 127 (1984). 

. "When a rejection depends on a combination of prior art references, there must 
h e some teaching, suggestion, or motivation to combine the references. See 
in re G&iger, 815 F.2d 686, 688, 2 USPQ2d 1276, 1278 (Fed. Cir. 1987). 
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nhdn.-n— nan or 'y ^ ^hiished bv romhininn ^^^^^S^ ° f 
prior art to produce the claimed in vention whergji gre ,s s 9 me teaching, 
° ti»n o" motivation to do so found either explicitly or implicitly in the 
SB^tnS^orln lhi knowledge generally ™ 
skill in the art. See MPEP 2143 01; In re Koteab. 217 F 3 M365 1370, 55 
USPQ2d 1313 1317 (Fed. Cir. 2000); In re Fine, 837 F.2d ™71, 5 USHi-wa loyD 
(fed Cir. 1988); and In re Jones, 958 F.2d 347, 21 USPQ2d 1941 (Fed. dr. 
1992). 

-With respect to core factual findings in a determination of patentability, ^ewer 
™»LtZ ei ^ p iv reach concl us i o n s based on it s own understanding 

0 7 eX D e rience --oron its assessment of what would be basic Know.edge or 

S^n^Te. P ,hw the Board must point w 
the record in support of these findings." See In re Zurko, 258 F.3d 1379 (Fed. 

Cir. 2001). 

"Wr hi rr nrt^ -rH?"" rtf a ■ llflBMtinn ' Aching, or motivation to 
combine may flow from the prior art references themselves. «^ . 
SSelfoTdinary skill in the art. or, in some cases from the naUjre of ^the problem to 
be solved, see Pro-Mold & Tool Co. v. Great Lakes Plastics. Inc. 75 F.3d 1568. 
1573 37 USPQ2d 1626, 1630 (Fed. Cir. 1996). Para-Ordinance Mfg. v. SGS 
Sports intern inc., 73 F.3d 1085, 1088, 37 USPQ2d 1 237 1 24C ) (Fed^ Cir 
1995^ althouah "the suggestion more often comes from the teachings ottne 
peSeS^s," Rouffet, 149 F.3d at 1355. 47 USPQ2d at 1456. The range 
of sources available, however, does not diminish the requirement for actual 
evidence. That is, the showing m ust be clear and particular. See, e.g., C.K. 
Bard 157 F 3d at 1352, 48 USPQ2d at 1232. Broad conclusorv statements 
,« n *rA'm a the te * *hina of multiple references, string «l W "» " ot 
"evidence." E.g.. McElmurry v. Arkansas Power & Light Co., 995 F.2d 1576. 
1578 27 USPQ2d 1129, 1131 (Fed. Cir. 1993) C'Mere denials and conclusory 
statements, however, are not sufficient to establish a genuine «sue of material 
fact"); in re Sichert, 566 F.2d 1154, 1164, 196 USPQ 209, 217 (CCPA 1977). 
See In re Dembiczak. 175 F. 3d 994 (Fed. Cir. 1999). 

. 'To prevent the use of hindsight based on the invention to defeat patentability of 
tho irwonti™ this court requi r e* the examiner to show a motivation to 
Mmhine the references that create the case of obviousness. In other words, the 
examiner must show reasons that the skilled artisan, confronted with the same 
problems as the inventor and with no knowledge of the claimed invention, would 
select the elements from the cited prior art references for combination in the 
manner claimed ." See In re Rouffet, 149. F.3d 1350 (Fed. Cir. 1998). 

• MPEP 21 43.01 -The Prior Art Must Suggest The Desirability Of The Claimed 
Invention. There are three possible sources for a motivation to combine 
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Terences: the nature of the problem to be solved ^^g^ 
and the knowledge of persons of ordinary skill in the art. In re Rouffet, 
1350 1357 47 USPQM 1453, 1457-58 (Fed. Cir. 1998) fThe combination of 

. mrt «w g tinn to combin e, » ruction basr>rt on a prima i facie cas e of 
JL hsld improper .). The lev el of skill in the art cannot rated I upon 

to provide the suggestion to combine references. Al-Site Corp. v. VSI Inti inc., 

174 F.3d 1308, 50 USPQ2d 1161 (Fed. Cir. 1999). 

. The mere fact that references can be combined or modified does not render the 
resultant combination obvious unless the prior art ""ffl**™ 14 ~ 0 
^irohiii h, nf the combination . In re Mills, 916 F.2d 680, 16 USPQ2d 1430 
(Fed Cir 1990). Although a prior art device "may be capable of being modrfied to 
run the wav the apparatus is claimed, there must b» « suggestion or 
^"«^rthe P r^f e rence to do so." 916 F.2d at 682, 16 USPQ2d la 432 ) 
Seerso"nreFritch,972F.2 d 1260, 23 USPQ2d 1780 (Fed. Cir. 199 iy (flexible 
landscape edging device which is conformable to a ground surface of varying 
slope not suggested by combination of prior art references). 

. if *h Q nr»nr> C Ari modification w ould render #»> "rior art Invention being 
mnriifcdul^tisfactorv for its intended purpose, th en there is no "fl^I? <* 
motivation t o make the proposed modification. In re Gordon, 733 F.2d 900, 221 
USPQ 1125 (Fed. Cir. 1984). 

C. Jain 

Prior to discussing the substantive merit of the obviousness rejections, it might be 
desirable to summarily review the Jain patent. Jain generally describes a system and 
method for content-based s earch and retrieval of visual objects. A base visual 
information retrieval (VIR) engine utilizes a set of universal primitives to operate on 
the visual objects. An extensible VIR engine allows custom, modular primitives to be 
defined and registered. A custom primitive addresses domain specific problems can 
utilize image understanding techniques. Object attributes can be extracted over the 
entire image or over only a portion of the object, a schema is defined as a specific 
rnitection of primitives . A specific schema implies a specific set of visual features 
to be processed and a corresponding feature vector to be used for content-based 
similarity scoring. A primitive registration interface registers custom primitives and 
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facilitates storing of an analysis function and a comparison function to a schema 
table. A heterogeneous comparison allows objects analyzed by different schemes to 
be compared if at least one primitive is in common between the schemas. A 
threshold-based comparison is utilized to improve performance of the VlR engine. A 
distance between two feature vectors is computed in any of the comparison 
processes so as to generate a similarity score. Refer to the Abstract. 

"The VlR Engine 120 comprises two main modules: an "Image Analysis" module 
122 and an "Image Comparison" module 124. The image analysis module 122 
receives inputs from either module 108 or 1 10 to generate a query target or from the 
insertion module 112 for adding a new image into the database 132. The output of 
the image analysis module 122 is a feature vector (FV) that describes the visual 
object passed to it by one of modules 108, 110 or 112. The FV is passed on to the 
database engine 130. In addition, if module 1 12 was used to insert the image into the 
database, both the FV for the image and the image itself are stored in the database 
132 (as seen in FIG. 5B). The image analysis module 122 will be described in greater 
detail hereinbelow. 

The image comparison module 124 receives a query target FV and a FV for the 
image being tested or compared from the database engine 130. The output of the 
Image comparison module 124 is a similarity score that is sent to a "Ranked List 
Management" module 134. A plurality of images from the database 1 32 are 
compared one at a time to the query Image by the image comparison module 124. 
The resultant similarity scores are accumulated by the module 134 so as to provide a 
rank in an order of their similarity to the query image. The ranked results of the list 
management module 134 are provided to a "Thumbnail Results Browser" 136 for 
display to the user 102 through the computer I/O 104. An exemplary screen display 
of ranked results is shown in FIG. 4." Reference is made to FIG. 1 A, and further to 
column 9, lines 41 - 67. 
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- what is needed is a new multimedia information system technology model such 
as a visual information management system (VIMSYS) model. Unlike traditional 
database systems, this model recognizes that most users prefer to search image 
m h video inform^™ hv what the T " ™ deo act "*» v ^her tHan 

h Y keywords or ^notions asso ^H with the visual information. The onjy. 
proper method by which the user can get access to the content of the image is by 
using image-analysis technology to extract the content from an image or video. 
Once extracted, the content represents most of what the user needs in order to 
organize, search, and locate necessary visual information. 

This breakthrough concept *™*«nt extraction alleviates several technological 
problems. The foremost benefit is that it gives a user the power to retrieve visual 
information hv dicing a query me all pictures that look like this." The 

system satisfies the query by ^mn a rina the content of the query picture with that 
of all target pictures in the database. This is called Query By Pictorial Example 
(QBPE), and is a simple form of content-based retrieval, a new paradigm in 
database management systems." Reference is mad to column 2, lines 53 - 65, with 
emphasis added. 

D. A pplication of the ObviousP *ftft Standard to the Present Invention 

D.1. Elements not disclosed bv Jain 

Applicant respectfully submits that the following elements and combination of 
elements and resulting features recited in the representative independent claim 1 and 
the claims dependent thereon, are not disclosed in Jain (with emphasis added): 

"1 . A system for automatically associating contextual input data with 
available multimedia resources, comprising: 

a contextual input device for capturing the contextual input data; 
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an assistant device for processing the contextual input data captured 
by the contextual input device, and for formulating a query pased on 

r e «H ^ntftrtual infr"* ■ "** r profil * and 

a contextual multimedia association module for associating the 
P^^pd conte nt input data w ith the multimedia resources and for 
generating association matches." Emphasis added. 

D.2. Sumr »ary f>f Arguments 

Applicant incorporates by reference all the arguments made in the previous 
response, and further respectfully submits a summary of the arguments to be 
developed in more detail in subsequent sections: 

D.2.a: .lain does nnr capture contextual in put data, 

D .2.b: lain rinss not formulate a auerv based on the processed contextual input 
data and th ft user profile. 

n 2.a: Jain does not capture C Q "^f«"al input data 

As it is clear from the Jain excerpts above, -Iain's method is strictly content: 
based, in that it is limiting to discovering and cataloguing flo potent of the input 
im aqe , lain rlMs not cpnt.TP contextua l input data, as understood and defined in 
the present application. 

th 0 torm ■mntmriual- is a ke y nonrept to the present invention, and is mentioned 
»inht times in thp instant claim 1 . Applicant respectfully requests that this term be 
given Its proper weight and not be summarily dismissed. The term "contextual" is 
clearly defined in the present application as follows: 
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ine auqun cvi ueud. ■ ~. — . r 

application, with emphasis added for clarity. 

"E xemplary, ^«-nvH„chi ft nontextual data include environmental 

■ ~ ' ... . a cnaAii mfttinn. 




acceleration, anu u ma uaiaiiicw^ , «~.w - _ 

of the present application, with emphasis added for clarity. 



The concept of capturing contextual input contextual input data, and then 
processing the captured contextual input data is neither taught nor suggested in Jain 

The text cited by the Examiner, which was reproduced in part, above, supports 
the finding that the capture of visual information is limited in scope to the content of 
the captured data. THE CITED TEXT CONFIRMS THAT JAIN IS CONTENT- 
BASED. AS OPPOSED TO CONTEXT-BASED, in that Jain seems to disregard the 
surrounding circumstances, such as the environmental and geospatial 
coordinates, time, temperature, location, speed, motion, or acceleration in. w^ch t h< 
content exists or the event occurs. 
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n n Jain does not teach a utomatically 

formulating the query b^ sed on the 
™ntaYtiial input data and the user profile 

(1) Applet agrees with the Examiner t hat Jain does not teach automatically 
formulating the query based on the user profile. 

H Ti ■rthrm— , Apr^snt «, .hmite that Jain does not teach automatica ll y 
formulating the au^ h aR pri on the m n« M h ia i inn.it data, since, as stated earlier, 
Jain seems to ignore the contextual data, and rather focuses on the content data. 

In order to compensate for the first missing element, the office action resorts to 
Polnerow, as discussed below. 

P. 3. The combination of -Jain and P nlnarow is improper 

In support of the combination of Jain and Polnerow, the office action adds that 
Polnerow teaches searching based on user profile (see col. 1 . lines 55-65 and 
column 10, lines 53-54), reasoning that: 

"It would have been obvious to a person of ordinary skill in the art at the 
time the invention was made to employ the teachings of Polnerow within the 
system of Jain by automatically searching database for information based on 
user profile within the contextual input data and multimedia data system 
associating system and method because. Jain teaches of user specific . 
nronertv or attribute of the image f or performing queries (see col.4 f lines 21- 
40) and such attributes could be users preference according to the users 
profile Since user supplies the property or attributes, theses attributes or 
pro perties could be derived accor ding to users preference such as users 
profile ." 
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Applicant respectfully traverses this rejection ground and submits the following 
arguments: 

(1 ) Jain limits the "specific property or attribute of the image" to what is referred to as 
"primitives" of the content See for example, column 6, lines 20-21 in Jain. There is, 
however, no justification or teaching in Jain to expand the "specific property or 
attribute of the image" to cover "the user's profile," particularly that Jain does not 
consider the user's profile to be an attribute of the image. This latter point is 
discussed in more detail below. 

(2) In addition, Polnerow does not disclose formulating the query based on the user's 
profile " for automatic^ associating ™nt«rhi:il input data with available 
multimedia resources." 

(3) Furthermore, neither Polnerow nor Jain teaches or suggests "formulating a query 
baS ed on processed contextual input date. " as presented earlier, and as clearly 
defined in the present application. 

(4) The Examiner bases the ground for combining Jain on Polnerow on the user's 
profile, but does not provide any ground for combining these two references based 
on the processed contextual input data . Applicant submits that these two 
references cannot be justifiably combined based on the processed contextual inpu t 
data, since this feature is neither suggested nor taught by any of these two 
references. 

Claim 1 and the claims dependent thereon are allowable, and such allowance is 
respectfully requested. Similarly, independent claims 13 and 39 and the claims 
dependent thereon are allowable for reciting comparable elements to those of claim 
1. 
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E. Dependent Claims 



f 1. Claims 7. 17. and 43 

Claims 7, 17, and 43 were rejected under 35 U.S.C. 103(a) as being unpatentable 
over Jain in view of Bull. 

Applicant respectfully traverses this rejection and submits that the rejected claims 
are not obvious in view of Jain and Bull, and are thus patentable thereover. In 
support of this position. Applicant submits Bull was referred to as teaching the 
development of a user profile. 

Applicant respectfully submits that the same arguments presented earlier in favor 
of allowance of claim 1 over Jain and Polnerow are equally applicable to the 
combination of Jain and Bull. Further, Bull stands for the generally known concept of 
developing a user profile, which, by itself, does not constitute the novel and 
patentable aspect of the present invention. 

The combination of Jain and Bull does not disclose the following elements of the 

representative claim 7: 

• "formulating a query based on processed contextual input data and a user 

profile"; and 

• "the assistant device develops the user profile based on association matches 
that were previously presented to the user". 

Claim 7 and the claims dependent thereon are allowable, and such allowance is 
respectfully requested. Similarly, independent claims 17 and 43 and the claims 
dependent thereon are allowable for reciting comparable elements to those of claim 
7. 
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F. 2. Claims «- 18- and 44 

The office action states that with regard to claims 8, 18. and 44, "Jain does not 
teach wherein th« assistant devic* ""Hates the user digital profile based on 

relation matches V™*™ "* "°d a tinn the user digital profile based 
n n r.r^nt association matches (see col.8, line 65 to col.9, line 2 and col.12, lines 2- 
4). It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to employ the teachings of Bull within the system of Jain by 
updating user profile within the contextual input data and multimedia data system 
associating system and method because, this would keep track of the potential future 
user as well as keep track of the user's preferences for future search "primitives" to 
speed up the processing time." Emphasis added. 

Applicant respectfully submits that the following elements and combination of 
elements and resulting features recited in the representative dependent claim 8 and 
the claims dependent thereon, are not disclosed in Jain (with emphasis added): 

"8. The system according to claim 7, wherein the assistant device updates 
the user digital profile baaed on recent assoc iation matches.' Emphasis 
added 

Applicant incorporates herein the presentation made earlier in favor of the 
allowance of claim 7, and further respectfully submits that claim 8 depends on claims 
1 and 7 as now amended, to include the following elements that are missing from 
Jain and Bull: 

• "formulating a query based on processed contextual input data and a user 
profile"; 

- "the assistant device develops the user profile based on association matches 
that were previously presented to the user"; and 
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♦ "the assistant device updates the user digital profile based on recent 
association matches". 

Claim 8 and the claims dependent thereon are allowable, and such allowance is 
respectfully requested. Similarly, independent claims 18 and 44 and the claims 
dependent thereon are allowable for reciting comparable elements to those of claim 
8. 



F. 3. Remaining depen dent claims 

The remaining dependent claims are allowable for depending on the allowable 
claims 1, 13, and 39, as presented earlier. 



TELEPHONE INTERVIEW 

The undersigned respectfully reiterates his request for a telephone interview with 
the following agenda: "Discuss claim 1 in view of Jain, Polnerow, and Bull," 
particularly in view of the "contextual" input data concept that is not disclosed in any 
of these three references. 
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CONCLUSION 

All the claims presently on file in the present application are in condition for 
immediate allowance, and such action is respectfully requested. If it is felt for any 
reason that direct communication would serve to advance prosecution of this case to 
finality, the Examiner is invited to call the undersigned at the below-listed telephone 
number. 



Respectfully submitted, 




Date; June 16. 2003 



Samuel A. Kassatly 
Attorney for Applicant 
Reg. No. 32,247 
Tel. (408) 323-5111 
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